Iranian J. of Numerical Analysis and Optimization 
Vol 3, No. 2, (2013), pp 1-12 


Hopf bifurcation analysis of a delayed 
five-neuron BAM neural network with 
two neurons in the X-layer 


E. Javidmanesh and Z. Afsharnezhad 


Abstract 


In this paper, a bidirectional associative memory (BAM) neural network, 
which consists of two neurons in the X-layer and three neurons in the Y- 
layer, with two time delays will be studied. We conclude that under some 
assumptions, Hopf bifurcation occurs when the sum of two delays passes 
through a critical value. A numerical example is presented to support our 
theoretical results. 
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1 Introduction 


The attention of many scientists (eg., mathematicians, physicists, computer 
scientists, engineers and so on) have been attracted toward the dynami- 
cal characteristics of artificial neural networks since Hopfield constructed 
a simplified neural network (NN) model [1]. As time delays always oc- 
cur in the signal transmission, Marcus and Westervelt proposed an NN 
model with delay [2]. Many dynamical behaviours such as periodic phe- 
nomenon, bifurcation and chaos have been discussed on these systems (e.g. 
[3, 4, 5, 6, 7, 8, 9, 2, 10]). 

The bidirectional associative memory (BAM) networks were first intro- 
duced by Kasko (e.g. [11, 12]). The properties of periodic solutions are 
significant in many applications. It is well known that BAM NNs are able 
to store multiple patterns, but most of NNs have only one storage pattern 
or memory pattern. BAM NNs have practical applications in storing paired 
patterns or memories and have the ability of searching the desired patterns 
through both forward and backward directions. 
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The delayed BAM neural network is described by the following system: 


{ &;(t) = — pia; (t) T pe ex filyj (t _ Tji)) +I; (i = 1, 2, tee ,n) (1) 
y(t) = —vjy;(t) + yaa diggs (w(t — o4j)) + Jy (F =1,2,...,m) 


where cj; and d;; are the connection weights through the neurons in two 
layers: the X-layer and the Y-layer. The stability of internal neuron processes 
on the X-layer and Y-layer are described by p; and v;, respectively. On the 
X-layer, the neurons whose states are denoted by 2;(t) receive the input 
I, and the inputs outputted by those neurons in the Y-layer via activation 
function f;, while the similar process happens on the Y-layer. Also, 7;; and 
04; correspond to the finite time delays of neural processing and delivery of 
signals. For further details, we refer to [12, 11]. 


Since a great number of periodic solutions indicate multiple memory pat- 
terns, the study of Hopf bifurcation is very important for the design and 
application of BAM NNs. In fact, various local periodic solutions can arise 
from the different equilibrium points of BAM NNs by applying Hopf bifur- 
cation technique. But the exhaustive analysis of the dynamics of such a 
large system is complicated, so some authors have studied the dynamical 
behaviours of simplified systems. For example, the simplified three-neuron, 
four-neuron, five-neuron and six-neuron BAM NNs with multiple delays have 
been studied in [13, 14, 6, 15, 8, 9, 16, 17, 10, 18, 19, 20]. It should be noted 
that in the above papers, the systems which have been considered, just con- 
sist of one neuron in the X-layer and other neurons in the Y-layer. This way 
of choosing the systems simplifies the analysis. Also, [20] studied the stability 
and local Hopf bifurcation of a five-neuron ring neural network with delays 
and self connection. However, there are many other forms of BAM NNs that 
have not been studied. 


Motivated by the above, in this paper, we consider the following five- 
neuron BAM neural network. We should point out that in [21], the following 
system has been studied through center manifold theory, but here, we study 
this system according to the distribution of roots. In [14], a more simplified 
form of (2) with some assumptions has been considered, but they have stated 
some results of synchronization. 


© (t) = —p121(t) + cir fir(yi(t — 72)) + car fi (yalt — 72) 
+¢31 f1(y3(t — T2)) 
Fo(t) = —p2xo(t) + cra fo(yr(t — T2)) + C22 fo(ya(t — 72)) 
3(t — T2)) (2) 


yo(t) = —veye(t) + dizg2(a1(t — T1)) + d22g2(x2(t — 71)) 
¥3(t) = —v3y3(t) + di3g93(@1(t — 71)) + do3g3(ro(t — 71)) 


Y 
yr (t) = —viyi( + diigi(x1(t — 71)) + doigi(x2(t — 71)) 
) 


where 4; > O(4 = 15.25 Vi > 0 = 132.3); €71,¢72(9 = 1, 2,3) and 
di1, diz, diz3(t = 1,2) are real constants. The time delay from the X-layer 
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to another Y-layer is 71, while the time delay from the Y-layer back to the 
X-layer is 72, and there are two neurons in the X-layer and three neurons in 
the Y-layer. First, we take the sum of the delays 7 = 7,-++7) as parameter and 
we will show that the zero solution loses its stability and Hopf bifurcation 
occurs when 7 passes through a critical value. 


This paper is organized in four sections. In section 2, we will analyze the 
stability and Hopf bifurcation. To illustrate the results, numerical simulation 
is presented in section 3. Finally, in section 4, some main conclusions are 
stated. 


2 Stability analysis and Hopf bifurcation 


First, we need to explain some transformations stated in [21]. Letting ui(t) = 
ai(t— 71), Ua(t) = v2(t— 71), ua(t) = yr(t), walt) = yo(t), us(t) = ys(t) and 
T =71 +72, system (2) can be rewritten as the following equivalent system: 


ui(t) = —piui(t) + ci fi(us(t — 7)) + cai fi(ua(t — T)) 
+31 f1 (us t-— T)) 
z(t) = —M2ua(t) + ci2fe(us(t — T)) + c22fo(ua(t — T)) 
+¢32 fo(us(t — T)) (3) 


To establish the main results for system (3), it is necessary to make the 
following assumption: 


(H1) fi,9; €C", fi(0) = 95(0) = 0, @ = 1,2; 7 = 1,2, 3). 


Note that the above assumption is necessary for linearization. It is easily 
seen that the origin (0,0,0,0,0) is an equilibrium point of (3). Under the 
hypothesis (H1), the linearization of (3) at (0,0,0,0,0) is 


u(t) = —p1u1(t) Tr a31u3(t bess T) an agua(t a T) + O51Us5(t a T) 

dia (t) = —p2ua(t) al as32u3(t a. T) + a4nua(t == T) + O52Us(t _ T) 

ui3(t) = —U1U3 (t) me a3 (E) +r 93U2 (t) (4) 
uia(t) = —vV2U4 (t) a a4 (E) +r 24U2 (t) 

Us(t) = —vgUs(t) + a15t1(t) + ag5u2(t) 


where Qmi = Crif{(0), Qim = dingj,(0) for m = 3,4,5, k = m—2,i =1,2. 
Then the associated characteristic equation of (4) is 
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A+ ji 0 316747 —aye-** —a5je7*7 
0 A+ pe —a32e-*7 —a4Qe—*7 —a52e-*7 
det —-A13 —A93 A+ U1 0 0 _ 0, 
—-A14 —QA24 0 Xr + v2 0 
—-Q15 —Q25 0 0 Xr + U3 


M+ adt + bd\P +04? + dA +e + (ard? + dA? + A+ die ™ 
+ (a2r + be?" = 0, (5) 


where 

a= V1 + Vg + U3 + Pe + L1, 

b = vVypvq + fev, + MgV2 + UZh1 + ViUZ + U2U3 + U3H2 + Ui ply + Vel + pipe, 
C= QU V2 + Vy UZ Ly + UQUZ3 [1 + [2V3 [1 £ U1 U2U3 + Vy UZ [2 + U2QU3 2 + V1 V2 [1 Ft 
M21 fy + M2v2/1, 

d = [12¥1VqV3 + MeV1 V2 ply + V{V2QV3 hy + MeV U3 hy + f2V2U3L1, 

€ = U3 H1H2U1 V2, 


a, = —52025 — A24A42 — 32023 — 31013 — A41A14 — 51015, 

by = —52095(U1 + V2 + f1) — A24Q42(U1 + U3 + fi) — 032023 (03 + V2 + H1) — 
431013(U3 + V2 + fla) — Q41Q14(V1 + U3 + M2) — a51015(V1 + V2 + L2), 

Cy = 052095 (V1 V2 +h V+ [1 V1) — A194 142 (V1U3 +f U3 +H V1) — 132193 (U302+ 


[U2 + 113) — 031013 (V3U2 + M2V3 + [l2V2) — O41 014(U103 + [23 + [201) 
51015(U1 V2 + W2V1 + [2V2), 

d, = 52095 H1U1VU2 — A24042U1U1U3 — &32023H1U2U3 — 31013H2U2U3 — 
41 A141H2U3V1 — 151015 12U1 V2, 


Gg = 031013052025 + 31013024042 — 1310140142023 — 
310115152023 — 0141013032024 + 141014052025 + 
410140230132 — 41015052042 — 451013032095 — 


014.0142. 01250151 1 151015142024 + 51015023032, 


bz = 031013052025V2 + 031013024042U3 — 0310140142023U3 
— 013101150152 0123V2 — 410130320243 + 4101405202501 
+ 01410114.01230132U3 — A4101150152042U1 — 0510113032025 02 


040142025051 V1 + 51015 A42A24V1 + 15101 523032U2. 


To study the distribution of the roots of (5), we make the following assump- 
tion: (If we assume that a2 = bg = 0 instead of (H2), the results in this case 
can be obtained from [19] analogously.) 


(H2) ay by C1 dy 0. 
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Then Eq. (5) reduces to 
M+ ad* + DA? +07 + dA +e + (a2A + dg)e->*? =0. (6) 


Obviously, iw(w > 0) is a root of Eq. (6) if and only if w satisfies (the real 
and imaginary parts have been separated) 


{ —bec0s(2wT) — aqwsin(2wr) = aw* — cw? + e, (7) 


—a2weos(2wr) + besin(2wr) = w® — bw? + dw. 


Taking square on the both sides of the equations of (7) and summing them 
up, we obtain 


w+ (a? — 2b)w% + (b? + 2Wd—2ac)w® 


(c? + 2ae — 2bd)w* + (d? —2ce—a})w? 
+e7—bF =0. (8) 


Let z = w? and for convenience, denote 
p = a* — 2b, q = b? + 2d—2ac, r = c? + 2ae—2bd, v = e? — b3, s = d? — 2ce— a2. 
Then Eq. (8) becomes 

2° + pzt +z2 +727 + sz+u=0. (9) 


Suppose that 


A(z) = 2° +pz*t+qz?t+rz*7+szt+v. 


The fact that Eq. (9) has positive roots is a necessary condition for the 
existence of pure imaginary roots of (6). The following four lemmas, which 
have been proved in [20], are going to be used to establish the distribution 
of positive real roots of Eq. (9). We should mention that the coefficients of 
Eq. (9) are different from those in Lemmas 2.1-2.4 in [20], but they have not 
changed the results of the lemmas. Hence, we can prove the following four 
lemmas analogously. So, we do not state the proofs. 


Lemma 1. If vu <0, then Eq. (9) has at least one positive root. 


Now, to study the distribution of positive roots of (9) when v > 0, consider 
the following equation that comes from h’(z) = 0: 


524 + Apz? + 3qz7 + 2rz +s =0. (10) 
Substituting z = y— 2 in Eq. (10), we have 


yi tpy?+nytri =0, (11) 


where pi = —35P" o 54 Pi TP fi JPY + aC) ri = a5? | ipsP4 


pr + £8. If gq: = 0, then it is very easy to obtain the four roots of Eq. (11) 
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as follows: 


Leg RE = —pi + VAo 
y= 5 » Y2= 2 ’ 


where Ag = p7 — 4r1. 


Lemma 2. Assume that v > 0 and q = 0. 

(I) If Ao < 0, then Eq. (9) has no positive real roots. 

(II) If Ao > 0, pi: > 0 and r, > 0, then Eq. (9) has no positive real roots. 
(III) If (I) and (II) are not satisfied, then Eq. (9) has positive real roots if 
and only if there exists at least one 2* € {21, 22, 23, za} such that z* > 0 and 
h(z*) <0, where z = yi — 8 (@=1,2,3,4). 


Denote py = —3Pi — 471, 92 = —gyP} + Bpim1 — GY Ai = g7P3 + 39, 
q2 oe q2 Fick 201 
Sx = ° t Ay t ° Ay f Pi; Ao = —S, Pi | 
2 ? 3 Sx — P1 
and A3 = —s, — p1 ae 


Lemma 3. Suppose that v > 0, q, #0 and sx > py. 

(I) If Ay < 0 and A3 < 0, then Eg. (9) has no positive real roots. 

(II) If (I) is not satisfied, then Eq. (9) has positive real roots if and only if 
there exists at least one z* € {21, 22, 23, 24} such that z* > 0 and h(z*) < 0, 
where y. = ot Pe TT yo = a Oe y3 = Vans y4 = 


vee—pi— VAs and z, = yi — § (4 =1,2,3,4). 


Lemma 4. Assume that v > 0, q@ 40 ands, < pi, then Eq. (9) has positive 
2 
real roots if and only if eae + * =0, 2 > 0 and h(Z) < 0, where 


- 1 
o> aGi-aa) ah 

Suppose that Eq. (9) has positive roots and without loss of generality, we 
assume that it has five positive roots, denoted by zj, k = 1,2,3,4,5. Then 
Eq. (8) has five positive roots wz = \/zj, k = 1,2,3,4,5. 

By Eq. (7), we have: 


aw? + (ab — agb)wh + (daz — cbz)wz + ebe 


cos(2w,.T) = a are 


% 


(bz — aaz)w? + (cag — bb2)w? + (dbz — ea2)wp 
azw? + b3 


sin(Qw,T) = 
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Thus, we get the corresponding 7 ) 


tion (6) has purely imaginary roots. 


> 0 such that the characteristic equa- 


. 1 - agw® + (abe — azb)wt + (daz — cb2)w? + ebs : 
7) = [cos~*( nt ( } a ag we ) + 2x, 
QW by + anw;, 
(12) 
where k = 1,2,3,4,5 and 7 =0,1,2,..., then +72w, is a pair of purely imag- 


inary roots of Eq. (6) with r = 7 ). Clearly, the sequence {7 ) 726 is 


increasing, and lim; +4007” = +00, k =1,2,3,4,5. 
Therefore, we can define 


10S Tp minxess,....5}{7 0}, Wo = Wko, 20 = Zao (13) 


For convenience, we make the following hypotheses: 


(H3) a > 0, ab—c > 0, c(ab—c) + a(e + bz — a(d+az)) > 0,e+b2 >0 
(ab — c)[c(d + az) — b(e + bz)] — [a(d + az) — e — by]? > 0. 


We also need the following result from Ruan and Wei [22]. 


Lemma 5. Consider the exponential polynomial 


P(A, e747, ...,€ 27) = AM + po yr1 +... + pr + po 
Spy epee a Ble as 
Be Ne ep tp ea 


where 7; > O0(4 = 1,2,...,m) and p\” (¢ = 0,1,2,...,m;7 = 1,2,...,n) are 
constants. As (1T1,72,---,Tm) vary, the sum of the orders of the zeros of 
P(A, e7*7,...,€7*™) on the open right half plane can change only if a zero 
appears on or crosses the imaginary axis. 


Proof. See [22]. oO 


Using Lemmas 1-5, we can easily obtain the following results on the dis- 
tribution of roots of the Eq. (6). 


Lemma 6. Assume that (H3) holds. 

I) If one of the following conditions holds: 

a)u <0; 

(b) v > 0, q = 0, Ao > 0 and py < 0 or rm, < O and there exists z* € 
{21, 22, 23, z4} such that z* > 0 and h(z*) < 0; 

chu >0, qm #0, Ss > pi, Ag > 0 or Ag > O and there exists z* © 
{21, 22, 23, 24} such that z* > 0 and h(z*) < 0; 

d)v>0, q 40, 8 < pi, Tose + bss = 0, 2 > 0 and A(z) <0, 

then all roots of Eq. (6) have negative real parts when T € [0,70). 
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(II) If none of the conditions (a)-(d) of (I) is satisfied, then all roots of Eq. (6) 
have negative real parts for all 7 > 0. 


Proof. When r = 0, Eq. (6) becomes 
dP + ad* + dAP + od? + (dt a2)A+e+ be =0. (14) 


By the Routh-Hurwitz criterion, all roots of Eq. (14) have negative real parts 
if and only if (H3) holds. From Lemmas 1-4, we know that if (a)-(d) of (I) 
are not satisfied, then Eq. (6) has no roots with zero real part for all 7 > 0. 
If one of (a)-(d) holds, when 7 4 7), k=1,...,5; 7 =0,1,..., Eq. (6) has 
no roots with zero real part and 7 is the minimum value of 7 so that Eq. (6) 
has purely imaginary roots. Applying Lemma 5, we obtain the conclusion of 
the lemma. 


Let 
X(T) = a(r) + iw(r) (15) 
be the root of Eq. (6) satisfying a(7) = 0, w(t) = wo. Then we have the 
following lemma: 


Lemma 7. Suppose that z = we, h’(zo) #0 and agua 4 0 (or be # 0). 
Then, at T = 70, £iwo is a pair of simple purely imaginary roots of Eq. (6). 
Moreover, 


dRe(A(7)) 40, 
dr 
also, aRe(A(ro)) and h'(z9) have the same sign. 


Proof. Differentiating Eq. (6) with respect to 7, we can easily obtain: 


dX)-1 _ (BA4 + 4ad3 + 3bd?2 + 2+ de” Faq 


[ 


dr: 2azd2 + 2b2r rN 
Then, we get 
dRe(X(70)),-1 204, 
| dr ope ra (20); 
where K = 4a3w§ + 4b3w2. Thus, we obtain 
. -dRe(A(r dRe(X(7)),_ sewt we 
sign EO) sign (PMO) 14 = sign nl 2)} 40. 


Since K, zp > 0, we conclude that the sign of gee) 


sign of h’ (zo). 


is determined by the 


Now, we state the main theorem: 


Theorem 1. Suppose that (H1), (H2) and (H3) hold. 
(I) If the conditions (a)-(d) of Lemma 6 are all not satisfied, then the zero 
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solution of system (3) is asymptotically stable for all tT > 0. 

(II) If one of the conditions (a)-(d) of Lemma 6 is satisfied, then the zero 
solution of system (3) is asymptotically stable for all 7 € (0,79). 

(III) If all the conditions as stated in (II) hold and h'(zo) 4 0, then system 
(3) undergoes a Hopf bifurcation at the zero solution as T passes through 79. 


Proof. By applying Lemmas 6, 7 and bifurcation theory, all parts can be 
easily proved. 


(For more information about bifurcation theory and Hopf bifurcation, see 
[23].) 


3 Numerical simulation 


In this section, we give a numerical simulation to support our theoretical 
analysis. We consider the following system 


“1 (t) = —0.52(t) + tanh(yi1(t — 72)) 
—tanh(yo(t — T2)) + 2tanh(y3(t — T2)) 
@9(t) = —aa(t) + tanh(yi(t — 72) 
+tanh(yo(t — T2)) + tanh(y3(t — 72)) (16) 
Y(t) = —2y1(t) + tanh(a1(t — 71)) — tanh(xo(t — 71)) 
yo(t) = —0.5y2(t) + tanh(a1(t — 1)) + tanh(x2(t — 71)) 
y3(t) = —0.5y3(t) + tanh(a1(t — 71)) — tanh(x2(t — 71)) 


which has (0,0,0,0,0) as an equilibrium point. From section 2, by (5) and 
(8), we can compute p = 9, q = 27.375, r = 32.3125, s = —24.43359375 and 
v = —0.984375. Then Eq. (9) has a unique positive real root zo = 0.5308. 
Its easy to show that 7) = 0.885959203, h’(z) > 0 and sign{ {BM} = 1, 
Here, we have chosen 7; = 0.3 and 72 = 0.4, Figure 1 shows that the origin 
is asymptotically stable. When 7 passes through the critical value 7, a Hopf 
bifurcation occurs and a family of stable periodic solutions bifurcates from 
the origin. In Figure 2, the bifurcating periodic solutions are presented by 
choosing 7, = 0.4 and 7) = 0.5. 


4 Conclusions 


In this paper, we discussed the dynamics of a class of BAM neural network 
with two neurons in the X-layer, three neurons in the Y-layer and two time 
delays. We have proved that the zero solution loses its stability and Hopf 
bifurcation occurs. In fact, a family of periodic solutions bifurcate from 
the zero solution when 7 passes through a critical value. Also, in the main 
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Figure 1: When 7, = 0.3 and 72 = 0.4, the origin is asymptotically stable. 


Figure 2: When 7, = 0.4 and 72 = 0.5, a family of periodic solutions bifur- 
cates from the origin. 
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theorem, we resulted asymptotically stability of the zero solution in system 
(3) under some conditions. Finally, the results have been illustrated through 
numerical simulations. 


At the end, for further research, we would like to point out that we dis- 


cussed the dynamics of a special class of BAM neural network, but the com- 
plexity found in this case might be carried out to larger networks under some 
conditions. 
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